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CLAIMS 



[Claim(s)] 

[Claim 1 ] In the pixel defective compensator which inputs the pixel signal outputted from the image sensor on 
which the color filter was put, and amends the pixel signal by the defective pixel in this image sensor this 
equipment An input means by which said pixel signal inputs the picture signal changed into the brightness 
component and the color difference component, A defective information output means to output the defective 
information according to the location of said defective pixel, Said defective amendment means is a pixel 
defective compensator characterized by amending and outputting the pixel value of the pixel according to said 
defective information with the pixel value of the contiguity pixel of this pixel including a defective amendment 
means to amend the defective pixel in the picture signal inputted into said input means. 

[Claim 2] It is the pixel defective compensator characterized by said defective amendment means amending the 
pixel value of the pixel according to said defective information in a compensator according to claim 1 with the 
pixel value of the picture signal of said brightness component and said color difference component. 
[Claim 3] Said input means is a pixel defective compensator characterized by inputting the picture signal 
changed with this conversion means including a conversion means for this equipment to change said pixel 
signal into a brightness component and a color difference component, and to output said picture signal in a 
compensator according to claim 1 . 

[Claim 4] In a compensator according to claim 3 said conversion means The high-frequency component and 
low-pass component of this picture signal are generated using the pixel which adjoins perpendicularly to the 
pixel in said picture signal. Generate the luminance signal of these quantities region and a low-pass component 
to said brightness component, and the color-difference signal of the color difference component of this picture 
signal is generated using the pixel which adjoins said processing-object pixel perpendicularly further. Said 
defective amendment means is a pixel defective compensator characterized by amending said luminance signal 
and color-difference signal. 

[Claim 5] It is the pixel defective compensator characterized by supplying the defective information according 
to the detection result of this detection means to said defective amendment means including a detection means 
by which said defective information output means detects the variation of said picture signal in a compensator 
according to claim 1 . 

[Claim 6] In a compensator according to claim 5 said detection means The 1st acquisition means which acquires 
the pixel value of the object pixel circumference, and the 2nd acquisition means which acquires the pixel value 
of said object pixel, Based on each pixel value acquired with the 1st and 2nd acquisition means, this judgment 
means is a pixel defective compensator characterized by outputting the defective information according to this 
judgment result to said defective amendment means including a judgment means to judge whether said object 
pixel is determined as a defective pixel. 

[Claim 7] It is the pixel defective compensator characterized by to output the defective information according to 
this comparison result to said defective amendment means including a comparison means compare with said 
pixel value average an equalization means compute a pixel value average by equalizing the pixel value from 
which said judgment means was acquired with said 1 st acquisition means in the compensator according to claim 
6, and the pixel value of said object pixel. 

[Claim 8] It is the pixel defective compensator characterized by carrying out the comparison test of whether 
said comparison means has the pixel value of said object pixel within the limits of predetermined [ of said pixel 
value average ] in a compensator according to claim 7. 
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[Claim 9] a compensator according to claim 8 — setting — said comparison means -- the difference of said pixel 
value average and pixel value of said object pixel » an operation means to compute an absolute value — 
containing — this — difference — the pixel defective compensator characterized by carrying out the comparison 
test of whether an absolute value is within the limits of predetermined [ said ]. 

[Claim 10] It is the pixel defective compensator characterized by including a setting means by which this 
equipment sets said predetermined range as adjustable in a compensator according to claim 8 or 9. 
[Claim 11] It is the pixel defective compensator characterized by said equalization means computing the pixel 
value average of the field except this object pixel in a compensator according to claim 7 among the pixels of the 
in-every-direction mxn pixel (m and n are three or more odd number) of the circumference centering on said 
object pixel. 

[Claim 12] It is the pixel defective compensator characterized by said equalization means computing the pixel 
value average of 5x5 pixels of every direction of the field except said object pixel in a compensator according to 
claim 1 1 . 

[Claim 13] It is the pixel defective compensator characterized by connecting a low pass mold filter means to the 
output of said defective amendment means in a compensator according to claim 5, as for this equipment. 
[Claim 14] As a result of said positional information output means 1 inspecting the defective pixel of said image 
sensor in a compensator according to claim 1 , said defective amendment means is a pixel defective compensator 
characterized by amending the pixel value of the pixel according to said positional information as defective 
information judged to be a defective pixel including a storage means to memorize beforehand the positional 
information showing the location of this defective pixel. 

[Claim 1 5] It is the pixel defective compensator which, as for this equipment, a low pass mold filter means is 
connected to the output of said conversion means in a compensator according to claim 14, and is characterized 
by said defective amendment means performing amendment processing of said defective pixel about the picture 
signal outputted from this low pass mold filter means. 

[Claim 1 6] It is the pixel defective compensator which said defective amendment means is the contiguity pixel 
value of in front of the pixel for defective amendment, and/or the back in a compensator according to claim 1 , 
and is characterized by interpolating the pixel value of said object pixel. 

[Claim 1 7] It is the pixel defective compensator which said defective amendment means is the pixel value of 
front Rhine of the pixel for defective amendment, and/or back Rhine in a compensator according to claim 1 , and 
is characterized by interpolating the pixel value of said object pixel. 

[Claim 1 8] According to the color component of the color filter with which the image pick-up eel [ in / means / 
said / defective amendment / on a compensator according to claim 1 and / in the pixel location of the pixel for 
amendment / said image sensor ] was covered, it is the pixel defective compensator characterized by choosing 
the amendment approach. 

[Claim 1 9] It is the pixel defective compensator characterized by for said color filter being a RGB primary color 
color filter, and said conversion means generating said picture signal from the RGB pixel signal outputted from 
said image sensor in a compensator according to claim 3. 

[Claim 20] It is the pixel defective compensator characterized by being the color filter with which said RGB 
primary color color filter arranged RB in checkers in G stripe array in the compensator according to claim 19. 
[Claim 21] It is the pixel defective compensator characterized by for said color filter being a complementary 
color color filter, and said conversion means generating said picture signal from the complementary color signal 
outputted from said image sensor in a compensator according to claim 3. 

[Claim 22] It is the defective pixel compensator characterized by this equipment containing said image sensor in 
a compensator according to claim 1 . 

[Claim 23] It is the defective pixel compensator characterized by including a record means to process the 
picture signal with which this equipment is outputted from said defective amendment means in a compensator 
according to claim 1 , and to record on an information storage. 

[Claim 24] In the pixel defective detection equipment which inputs the pixel signal outputted from the image 
sensor on which the color filter was put, and detects the pixel signal by the defective pixel in this image sensor 
this equipment An input means by which said pixel signal inputs the picture signal changed into the brightness 
component and the color difference component, and a detection means to detect the variation of said picture 
signal are included. This detection means The 1 st acquisition means which acquires the pixel value of said 
object pixel circumference, and the 2nd acquisition means which acquires the pixel value of said object pixel, 
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Based on each pixel value acquired with the 1st and 2nd acquisition means, this judgment means is pixel 
defective detection equipment characterized by outputting this judgment result including a judgment means to 
judge whether said object pixel is determined as a defective pixel. 

[Claim 25] It is pixel defective detection equipment characterized by to output said judgment result according to 
this comparison result including a comparison means compare with said pixel value average an equalization 
means compute a pixel value average by equalizing the pixel value from which said judgment means was 
acquired with said 1st acquisition means in detection equipment according to claim 24, and the pixel value of 
said object pixel. 

[Claim 26] It is pixel defective detection equipment characterized by carrying out the comparison test of 
whether said comparison means has the pixel value of said object pixel within the limits of predetermined [ of 
said pixel value average ] in detection equipment according to claim 25. 

[Claim 27] detection equipment according to claim 26 ~ setting — said comparison means — the difference of 
said pixel value average and pixel value of said object pixel — an operation means to compute an absolute value 
— containing — this — difference — the pixel defective detection equipment characterized by carrying out the 
comparison test of whether an absolute value is within the limits of predetermined [ said ]. 
[Claim 28] It is pixel defective detection equipment characterized by including a setting means by which this 
equipment sets said predetermined range as adjustable in detection equipment according to claim 26 or 27. 
[Claim 29] It is pixel defective detection equipment characterized by said equalization means computing the 
pixel value average of the field except this object pixel in detection equipment according to claim 25 among the 
pixels of the in-every-direction mxn pixel (m and n are three or more odd number) of the circumference 
centering on said object pixel. 

[Claim 30] It is pixel defective detection equipment characterized by said equalization means computing the 
pixel value average of 5x5 pixels of every direction of the field except said object pixel in detection equipment 
according to claim 29. 

[Claim 31] Said input means is pixel defective detection equipment characterized by inputting the picture signal 
changed with this conversion means including a conversion means for this equipment to change said pixel 
signal into a brightness component and a color difference component, and to output said picture signal in 
detection equipment according to claim 24. 

[Claim 32] It is pixel defective detection equipment characterized by to generate the high-frequency component 
and the low-pass component of this pixel signal using the pixel which adjoins a pixel [ in / on detection 
equipment according to claim 31 and / in said conversion means / said pixel signal ] perpendicularly, to 
generate the luminance signal of these quantities region and a low-pass component to said brightness 
component, and to generate the color-difference signal of the color-difference component of this pixel signal 
using the pixel which adjoins said processing-object pixel perpendicularly further. 

[Claim 33] In the pixel defective amendment approach which inputs the pixel signal outputted from the image 
sensor on which the color filter was put, and amends the pixel signal by the defective pixel in this image sensor 
this approach The input process as which said pixel signal inputs the picture signal changed into the brightness 
component and the color difference component, The defective information output process which outputs the 
defective information according to the location of said defective pixel, Said defective amendment process is the 
pixel defective amendment approach characterized by amending the pixel value of the pixel according to said 
defective information with the pixel value of the contiguity pixel of this pixel including the defective 
amendment process which amends the defective pixel in the picture signal inputted at said input process. 
[Claim 34] It is the pixel defective amendment approach characterized by said defective amendment process 
amending the pixel value of the pixel according to said defective information in the amendment approach 
according to claim 33 with the pixel value of the picture signal of said brightness component and said color 
difference component. 

[Claim 35] Said input process is the pixel defective amendment approach characterized by inputting the picture 
signal changed at this conversion process including the conversion process which this approach changes said 
pixel signal into a brightness component and a color difference component, and outputs said picture signal in 
the amendment approach according to claim 33. 

[Claim 36] In the amendment approach according to claim 35 said conversion process The high-frequency 
component and low-pass component of this picture signal are generated using the pixel which adjoins 
perpendicularly to the pixel in said picture signal. Generate the luminance signal of these quantities region and a 
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low-pass component to said brightness component, and the color-difference signal of the color difference 
component of this picture signal is generated using the pixel which adjoins said processing-object pixel 
perpendicularly further. Said defective amendment process is the pixel defective amendment approach 
characterized by amending said luminance signal and color-difference signal. 

[Claim 37] It is the pixel defective amendment approach characterized by generating the defective information 
according to the detection result in this detection process including the detection process at which said defective 
information output process detects the variation of said picture signal in the amendment approach according to 
claim 33. 

[Claim 38] In the amendment approach according to claim 37 said detection process The 1st acquisition process 
which acquires the pixel value of said object pixel circumference, and the 2nd acquisition process which 
acquires the pixel value of said object pixel, Based on each pixel value acquired at the 1st and 2nd acquisition 
processes, this judgment process is the pixel defective amendment approach characterized by generating the 
defective information according to this judgment result including the judgment process which judges whether 
said object pixel is determined as a defective pixel. 

[Claim 39] It is the pixel defective amendment approach characterized by generating the defective information 
according to this comparison result including the comparison process which compares the pixel value of said 
object pixel with said pixel value average an average chemically-modified [ which computes a pixel value 
average by equalizing the pixel value from which said judgment process was acquired with said 1 st acquisition 
means in the amendment approach according to claim 38 ] degree. 

[Claim 40] It is the pixel defective amendment approach characterized by carrying out the comparison test of 
whether said comparison process has the pixel value of said object pixel within the limits of predetermined [ of 
said pixel value average ] in the amendment approach according to claim 39. 

[Claim 41] the amendment approach according to claim 40 ~ setting — said comparison process — the 
difference of said pixel value average and pixel value of said object pixel — the operation process which 
computes an absolute value — containing ~ this — difference — the pixel defective compensator characterized by 
carrying out the comparison test of whether an absolute value is within the limits of predetermined [ said ]. 
[Claim 42] It is the pixel defective amendment approach characterized by including the setting process at which 
this approach sets said predetermined range as adjustable in the amendment approach according to claim 40 or 
41. 

[Claim 43] It is the pixel defective amendment approach characterized by an average chemically-modified 
[ said ] degree computing the pixel value average of the field except this object pixel in the amendment 
approach according to claim 39 among the pixels of the in-every-direction mxn pixel (m and n are three or more 
odd number) of the circumference centering on said object pixel. 

[Claim 44] It is the pixel defective compensator characterized by an average chemically-modified [ said ] 
degree computing the pixel value average of 5x5 pixels of every direction of the field except said object pixel in 
the amendment approach according to claim 43. 

[Claim 45] It is the pixel defective amendment approach characterized by performing low pass mold filtering to 
the picture signal with which this approach was amended at said defective amendment process in the 
amendment approach according to claim 37. 

[Claim 46] As a result of said positional-information output process's inspecting the defective pixel of said 
image sensor in the amendment approach according to claim 33, said defective amendment process is the pixel 
defective amendment approach characterized by to amend the pixel value of the pixel according to said 
positional information as defective information judged to be a defective pixel including the storage process 
which memorizes beforehand the positional information showing the location of this defective pixel. 
[Claim 47] It is the pixel defective amendment approach which this approach performs low pass mold filtering 
in the amendment approach according to claim 46 to the picture signal amended at said conversion process, and 
is characterized by said defective amendment process performing amendment processing of said defective pixel 
about this picture signal by which low pass mold filtering was carried out. 

[Claim 48] It is the pixel defective amendment approach which said defective amendment process is the 
contiguity pixel value of in front of the pixel for defective amendment, and/or the back in the amendment 
approach according to claim 33, and is characterized by interpolating the pixel value of said object pixel. 
[Claim 49] It is the pixel defective amendment approach which said defective amendment process is the pixel 
value of front Rhine of the pixel for defective amendment, and/or back Rhine in the amendment approach 
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according to claim 33, and is characterized by interpolating the pixel value of said object pixel. 
[Claim 50] According to the color component of the color filter with which the image pick-up eel [ in / process / 
said / defective amendment / on the amendment approach according to claim 33 and / in the pixel location of the 
pixel for amendment / said image sensor ] was covered, it is the pixel defective amendment approach 
characterized by choosing the amendment approach. 

[Claim 5 1 ] It is the pixel defective amendment approach characterized by said conversion process generating 
said picture signal from the RGB pixel signal outputted from said image sensor when said color filter is a RGB 
primary color color filter in the amendment approach according to claim 35. 

[Claim 52] It is the pixel defective amendment approach characterized by being the color filter with which said 
RGB primary color color filter arranged RB in checkers in G stripe array in the amendment approach according 
to claim 51. 

[Claim 53] It is the pixel defective amendment approach characterized by said conversion process generating 
said picture signal from the complementary color signal outputted from said image sensor when said color filter 
is a complementary color color filter in the amendment approach according to claim 35. 
[Claim 54] It is the defective pixel amendment approach characterized by including the record process which 
processes the picture signal with which this approach was amended at said defective amendment process in the 
amendment approach according to claim 33, and is recorded on an information storage. 
[Claim 55] In the pixel defective detection approach of inputting the pixel signal outputted from the image 
sensor on which the color filter was put, and detecting the pixel signal by the defective pixel in this image 
sensor this approach The input process as which said pixel signal inputs the picture signal changed into the 
brightness component and the color difference component, and the detection process which detects the variation 
of said picture signal are included. This detection process The 1 st acquisition process which acquires the pixel 
value of said object pixel circumference, and the 2nd acquisition process which acquires the pixel value of said 
object pixel, Based on each pixel value acquired at the 1st and 2nd acquisition processes, this judgment process 
is the pixel defective detection approach characterized by outputting this judgment result including the 
judgment process which judges whether said object pixel is determined as a defective pixel. 
[Claim 56] It is the pixel defective detection approach characterized by to output said judgment result according 
to this comparison result including the comparison process which compares the pixel value of said object pixel 
with said pixel value average an average chemically-modified [ which computes a pixel value average by 
equalizing the pixel value from which said judgment process was acquired with said 1 st acquisition means in 
the detection approach according to claim 55 ] degree. 

[Claim 57] It is the pixel defective detection approach characterized by carrying out the comparison test of 
whether said comparison process has the pixel value of said object pixel within the limits of predetermined [ of 
said pixel value average ] in the detection approach according to claim 56. 

[Claim 58] the detection approach according to claim 57 — setting — said comparison process — the difference 
of said pixel value average and pixel value of said object pixel — the operation process which computes an 
absolute value — containing — this — difference — the pixel defective detection approach characterized by 
carrying out the comparison test of whether an absolute value is within the limits of predetermined [ said ]. 
[Claim 59] It is the pixel defective detection approach characterized by including the setting process at which 
this approach sets said predetermined range as adjustable in the detection approach according to claim 57 or 58. 
[Claim 60] It is the pixel defective detection approach characterized by an average chemically-modified [ said ] 
degree computing the pixel value average of the field except this object pixel in the detection approach 
according to claim 56 among the pixels of the in-every-direction mxn pixel (m and n are three or more odd 
number) of the circumference centering on said object pixel. 

[Claim 61] It is the pixel defective detection approach characterized by an average chemically-modified [ said ] 
degree computing the pixel value average of 5x5 pixels of every direction of the field except said object pixel in 
the detection approach according to claim 60. 

[Claim 62] Said input process is the pixel defective detection approach characterized by inputting the picture 
signal changed at this conversion process including the conversion process which this approach changes said 
pixel signal into a brightness component and a color difference component, and outputs said picture signal in 
the detection approach according to claim 55. 

[Claim 63] It is the pixel defective detection approach characterized by to generate the high-frequency 
component and the low-pass component of this pixel signal using the pixel which adjoins a pixel [ in / on the 
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detection approach according to claim 62 and / in said conversion process / said pixel signal ] perpendicularly, 
to generate the luminance signal of these quantities region and a low-pass component to said brightness 
component, and to generate the color-difference signal of the color-difference component of this pixel signal 
using the pixel which adjoins said processing-object pixel perpendicularly further. 



[Translation done.] 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention inputs the pixel signal outputted from the image sensor on which the 
color filter was put, detects the pixel signal by the defective pixel in an image sensor, and relates to the pixel 
defective compensator, the pixel defective detection equipment, and the approach of amending the pixel defect 
in the solid state image sensor with which the pixel defective compensator, the pixel defective detection 
equipment, and the approach of amending were started, for example, the primary color filter was put on the 
image pick-up side. 
[0002] 

[Description of the Prior Art] In recent years, a field is picturized, the field image and image are digitized, and a 
magnetic tape, a rotation record medium, and the digital camera further recorded on semiconductor memory are 
spreading. A CCD solid state image sensor and an MOS type pickup device are carried in such a camera, and 
the demand to the formation of a high pixel consistency has been increasing to it. 

[0003] For example, with a digital still camera, the solid state image sensor which has an image pick-up eel 1 
million pixels or more has come to be used. The various color filters for forming a color picture are carried in 
such each image pick-up eel of the image sensor of the veneer. 

[0004] However, in each image pick-up eel, the so-called crack by which the charge according to light income 
is not generated from various reasons occurs. When that image was displayed, the pixel signal corresponding to 
the eel, i.e., the defective pixel, of this crack condition was conspicuous according to the situation, and had 
become the cause of lowering the quality of a special photography image. 

[0005] Then, when using such a color image sensor, the amendment method of various kinds of defective pixels 
is developed and put in practical use. 

[0006] For example, the solid state camera which carries out defective amendment after carrying out sample 
hold of the output of the color CCD image sensor of color coating of a complementary color check method and 
digitizing it, performs various kinds of signal processing to the CCD output by which defective amendment was 
carried out, and obtains a video outlet was indicated by JP,6-30425,A. 

[0007] Moreover, the information about a defective pixel is memorized to nonvolatile memory, and the 
defective pixel detection system of a CCD solid state image sensor was indicated by JP,9-205586,A. It was that 
by which the defective pixel detection amendment circuit for performing detection and its amendment of a 
defective pixel is prepared between the solid state image sensor and the digital disposal circuit in this official 
report. 
[0008] 

[Problem(s) to be Solved by the Invention] However, at the former, since defective pixel amendment was 
performed before signal processing, by the case where software performs amendment processing, there was a 
problem that it was restricted to the number of pixels which can be amended in the time limit according to 
signal processing. 

[0009] Moreover, especially in the color image sensor of the veneer, interpolation processing needed to be 
carried out by few RGB pixels of a pixel according to a color filter array, i.e., the pixel which adjoins between 
same color color filters, for this reason, many the Rhine memory, registers, etc. holding a surrounding pixel in 
an amendment circuit were needed, and there was a problem that an amendment circuit was complicated. That 
is, when amending a defective pixel, if the pixel of in front of the pixel for amendment and the back and the 

http://www4.ipdl.ncipi.go.jp/cgi-bin/tran_web_cgi_ejje 8/3 1 /2005 



JP,2001-016599,A [DETAILED DESCRIPTION] 



Page 2 of 7 



pixel of the color filter of the same color contiguity pixel of vertical Rhine are used, in order for the distance 
between pixels to become large and to carry out storage maintenance of such a pixel, many store circuits, such 
as the Rhine memory and a register, needed to be prepared in the amendment circuit. 

[0010] This invention cancels the fault of such a conventional technique, a defective pixel can be amended, 
without a circuit scale increasing according to the color filter which an image sensor has, and it aims at offering 
the pixel defective compensator, the pixel defective detection equipment, and the approach of being stabilized 
and detecting a defective pixel. 
[0011] 

[Means for Solving the Problem] In the pixel defective compensator which this invention inputs the pixel signal 
outputted from the image sensor on which the color filter was put in order to solve an above-mentioned 
technical problem, and amends the pixel signal by the defective pixel in an image sensor An input means by 
which this equipment inputs the picture signal from which the pixel signal was changed into the brightness 
component and the color difference component, A defective information output means to output the defective 
information according to the location of a defective pixel, and a defective amendment means to amend the 
defective pixel in the picture signal inputted into an input means are included. A defective amendment means It 
is characterized by amending and outputting the pixel value of the pixel according to defective information with 
the pixel value of the contiguity pixel of this pixel. 

[0012] Moreover, in order to solve an above-mentioned technical problem, this invention inputs the pixel signal 
outputted from the image sensor on which the color filter was put, and sets it to the pixel defective detection 
equipment which detects the pixel signal by the defective pixel in an image sensor. This equipment includes an 
input means by which a pixel signal inputs the picture signal changed into the brightness component and the 
color difference component, and a detection means to detect the variation of a picture signal. A detection means 
The 1st acquisition means which acquires the pixel value of the object pixel circumference, and the 2nd 
acquisition means which acquires the pixel value of an object pixel, Based on each pixel value acquired with the 
1st and 2nd acquisition means, a judgment means is characterized by outputting a judgment result including a 
judgment means to judge whether an object pixel is determined as a defective pixel. 

[0013] Furthermore, in order to solve an above-mentioned technical problem, this invention inputs the pixel 
signal outputted from the image sensor on which the color filter was put, and sets it to the pixel defective 
amendment approach which amends the pixel signal by the defective pixel in an image sensor. The input 
process as which, as for this approach, a pixel signal inputs the picture signal changed into the brightness 
component and the color difference component, A defective amendment process is characterized by amending 
the pixel value of the pixel according to defective information with the pixel value of the contiguity pixel of this 
pixel including the defective information output process which outputs the defective information according to 
the location of a defective pixel, and the defective amendment process which amends the defective pixel in the 
picture signal inputted at an input process. 

[0014] Moreover, in order to solve an above-mentioned technical problem, this invention inputs the pixel signal 
outputted from the image sensor on which the color filter was put, and sets it to the pixel defective detection 
approach of detecting the pixel signal by the defective pixel in an image sensor. This approach includes the 
input process as which a pixel signal inputs the picture signal changed into the brightness component and the 
color difference component, and the detection process which detects the variation of a picture signal. A 
detection process The 1st acquisition process which acquires the pixel value of the object pixel circumference, 
and the 2nd acquisition process which acquires the pixel value of an object pixel, Based on each pixel value 
acquired at the 1st and 2nd acquisition processes, a judgment process is characterized by outputting a judgment 
result including the judgment process which judges whether an object pixel is determined as a defective pixel. 
[0015] 

[Embodiment of the Invention] Next, the example which applied the pixel defective compensator by this 
invention to the digital camera with reference to the accompanying drawing is explained to a detail. If drawing 
1 is referred to, photo electric conversion of the optical image by which image formation is carried out through 
the image pick-up lens 12 is carried out with an image sensor 14, and the digital camera 10 which generates the 
color picture signal according to a field image, and is stored in the information storage of memory card 1 6 grade 
is shown. This digital camera 10 has the function to correct the defective pixel generated with an image sensor 
14, by performing detection processing and amendment processing of a defective pixel to the output signal of 

http://www4.ipdl.ncipi.go.jp/cgi-bin/tran_web_cgi_ejje 8/3 1/2005 



JP,2001-016599,A [DETAILED DESCRIPTION] 



Page 3 of 7 



YC processing section 18. In addition, the part which does not have the direct relation to this invention in the 
following explanation omits illustration and its explanation, and the reference mark of a signal is expressed with 
the reference number of the appearing path cord. 

[0016] An image sensor 14 is an output 100 as a pixel signal with which a perpendicular and multiple image 
pick-up eel is formed horizontally, the charge according to the amount of the light which reaches the photodiode 
of each eel is generated, this is read through two or more perpendicular charge transfer ways and level charge 
transfer ways corresponding to each eel, and the pixel value according to the light income of each eel is 
expressed. It is the solid state image sensor to output. The color filter with which the spectral characteristics for 
generating the micro lens and color picture which condense the flux of light from the image pick-up lens 12 
differ is formed in the light-receiving side of each eel, in this example, the primary color color filter of the filter 
array shown in drawing 2 is put, and the image pick-up eel from which the spectral sensitivity characteristic 
differs in every R-G-B (red, green, and blue), respectively is formed. This color filter is a color filter of a G 
stripe RB perfect check array with which G filter is perpendicularly arranged in the shape of a stripe, and the 
color filter train of RB and BR is arranged by turns for between [ every ] G filter trains. 

[0017] The black crack which shows the white crack which the image pick-up eel which does not generate the 
electrical signal according to light income occurs in a solid state image sensor, for example, generally indicates 
the pixel of a bright condition to be light income to it independently from the problem on the manufacture, and 
a dark condition is included in the output signal. If it sorts out so that these may be lost completely, it will lead 
to the fall of the yield. Then, according to extent of the crack generating, amending the pixel value from the 
image pick-up eel of the crack condition is performed to the output signal of an image sensor. For example, 
supposing specific R pixels were a defective pixel, amending the pixel value of a defective pixel was performed 
to the defective pixel using other values of R pixels which adjoin paying attention to the same color component. 
However, it is the pixel signal 100, without being based on such an approach in this example. It is constituted so 
that defective amendment may be performed to the luminance signal Y changed and generated and YC picture 
signal of a color-difference signal C and such a YC picture signal may detect a defective pixel. 
[0018] output 100 of an image sensor 14 **** -- the dot order according to a filter array — the following RGB a 
pixel signal should be outputted and pass a non-illustrated correlation duplex sampling circuit — it is inputted 
into the sample hold circuit 20. RGB held here Point sequential pixel signal 102 Analog-to-digital conversion 
(ADC) It is changed into a digital image signal discrete in a circuit 22. 

[0019] Analog-to-digital conversion (ADC) Output 104 of a circuit Connecting with YC processing section 18, 
YC processing section 18 is ADC. RGB outputted from a circuit 22 Pixel signal 104 It is the processing circuit 
changed into a luminance signal Y and YC picture signal of a color-difference signal C. 
[0020] A front Rhine pixel [ in / to the pixel of a processing object / in YC processing section 1 8 in this 
example / Rhine in front of one ], 3 pixels by which the direction of a perpendicular (length) with the back 
Rhine pixel in Rhine after one has been arranged up and down, Or a luminance signal Y and color-difference 
signals Cr and Cb as generated the high-frequency component YH and the low-pass component YL of a picture 
signal and shown in drawing 3 thru/or drawing 5 using 6 pixels which added 3 pixels which adjoins in it 
horizontally It generates. 

[0021] RGB digitized in detail as YC processing section 18 was shown in drawing 6 Pixel signal 104 Buffer 
memory 600 stored temporarily Buffer memory 600 from — RGB read Pixel signal 602 choosing — desired 
outputs 604a, 604b, 604c, and 604d the selection circuitry (SEL) to output — 606 It has. YH generation 
processing section 608 connected to the output 604a, and YL generation processing section 610 connected to 
output 604b The high-frequency component YH and the low-pass component YL of a luminance signal are 
computed by the predetermined operation approach using the 3-pixel value distributed over the lengthwise 
direction inputted. YH generation processing section 608 a high-frequency component YH output — adder 612 
one input and low pass filter (LPF) — 614 it connects — having — YL generation processing section 610 a low- 
pass component output — adder 612 It connects with the input of another side, adder 612 a high-frequency 
component YH and the low-pass component YL — compounding — signal (YL-YH) generating — a low pass 
filter (LPF) - 616 It supplies. Adder 618 Each LPF 614,616 The luminance signal of ( YL- YH)+ YH for the 
processed component signal is compounded, and it is an output 106 about a luminance signal Y. It outputs. 
[0022] selection circuitry 606 Outputs 604c and 604d Cr generation processing section 620 connected, 
respectively And Cb generation processing section 622 the 3-pixel value or a 6-pixel value which was 
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mentioned above distributed perpendicularly similarly — using — color difference components Cr and Cb 
generating — a low pass filter (LPF) 624,626 respectively — these color difference component — filtering — 
carrying out — color-difference signal C (Cr, Cb) It outputs to an output 108. 

[0023] thus, YC processing circuit 18 — RGB RGB [ in / interpolation processing is carried out from pixel data, 
and / each pixel location ] after computing each pixel value, YC processing is not performed but it adjoins — 
each signal of brightness and a color difference component is generated from 3 pixels long at least. Output 106 
of YC processing circuit 18 And 108 It connects with the defective pixel detecting element 24 and the defective 
amendment processing section 26, respectively. 

[0024] The defective pixel detecting element 24 is an input 106,108. It is the processing section which detects 
the defective pixel in an image sensor 14 from the luminance signal Y inputted, respectively and a color- 
difference signal C. When the defective pixel detecting element 24 judges whether the pixel of a processing 
object is a defective pixel and detects a defective pixel from the variation of a luminance signal Y and a color- 
difference signal C, it outputs defective information. 

[0025] The defective pixel detecting element 24 in this example judges whether they are whether the 
processing-object pixel is a defective pixel and a normal pixel value that is, with the pixel value of a processing- 
object pixel, and the circumference pixel value which approaches a processing-object pixel and exists on the 
outskirts. As shown in drawing 7 in detail, the defective pixel detecting element 24 the circumference pixel 
acquisition processing section 700 which acquires the surrounding pixel value of a processing-object pixel in 
case it judges whether the present pixel is a defective pixel The object pixel acquisition processing section 702 
which acquires the pixel value of a processing-object pixel The judgment processing section 704 which judges 
whether a processing-object pixel is a defective pixel Judgment processing section 704 The setting processing 
section 706 which sets the threshold for judging as adjustable It contains. Judgment processing section 704 The 
equalization processing section 708 which equalizes the pixel value of a circumference pixel further The data- 
processing section 710 which computes the correlation of the circumference pixel value and the pixel value of 
an object pixel which were equalized Data-processing section 710 The comparison processing section 712 
which outputs the comparison result which shows whether the result of an operation and the threshold which 
can be set are compared, and it judges with a processing-object pixel being the pixel value of a defect It 
contains. 

[0026] Circumference pixel income processing section 700 A detection field is prepared around a processing- 
object pixel, and it has the function which carries out temporary storage maintenance of those pixel values. The 
circumference pixel income processing section 700 in this example As shown in drawing 8 , it is the object 
pixel 800. 5x5 pixel field 802 of every direction made into a core Each pixel value is memorized, respectively. 
Not only this but the circumference pixel income processing section 700 As shown in drawing 9 , it is the object 
pixel 900. Surrounding 3x3-pixel field 902 It is good to acquire the pixel value of the detection field where the 
above every direction consists of numbers of pixels of odd pieces, respectively. This detection area size is good 
also as a still larger field according to the resolution expected the total number of pixels of an image sensor 14. 
since 3 pixels of a perpendicular direction are used in this example in case YC signal is generated — moreover, 
the number [ equal to it for detection of a pixel defect ] of pixels in every direction — or the detection field of 
the larger number of pixels than it is set up. 

[0027] It returns to drawing 7 and is the circumference pixel acquisition processing section 700. It is the 
judgment processing section 704 about the pixel value of a circumference pixel. Equalization processing section 
708 It supplies. Moreover, the circumference pixel income processing section 700 It is the object pixel 
acquisition processing section 702 about a processing-object pixel. It supplies and is the object pixel acquisition 
processing section 702. It stores temporarily in order to take the output timing of the pixel value, and it is the 
judgment processing section 704. Data-processing section 710 It supplies. Equalization processing section 708 
It is the processing section which computes the average of the circumference pixel value inputted, and the pixel 
value average except the processing-object pixel of the center in a detection field is computed. 
[0028] Data-processing section 710 Equalization processing section 708 It is the processing section which 
computes the difference and its absolute value of the computed pixel value average and the pixel value of the 
object pixel supplied, and computes whenever [ correlation / of** values ]. Therefore, in this example, 
whenever [ correlation ] will be high, so that whenever [ correlation ] is conversely small so that a calculation 
result is large low. When whenever [ correlation ] is high, even if the pixel value of an object pixel of 
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correlation with a circumference pixel is high, an object pixel is a defective pixel and that is not right, it is the 
pixel value which is not conspicuous as a crack. Conversely, when whenever [ correlation ] is low, correlation 
with a circumference pixel has the low pixel value of an object pixel, for example, it is in the crack condition 
which is conspicuous as the luminescent spot or scotoma. 

[0029] whenever [ correlation / which was computed ] — the comparison processing section 712 it sends — 
having — the comparison processing section 712 Whenever [ correlation ], and the setting processing section 
706 from — by comparing the threshold supplied, the comparison test of whether it is within the limits had and 
permitted [ width of face / a certain ] in whenever [ correlation ] is carried out. Comparison processing section 
712 Comparison output 714 The output of the defective pixel detecting element 24 is constituted, and it 
connects with the defective amendment processing section 26. thus, in this example, it serves, and it suits, and a 
defective judging is come out and carried out and the defective information for amending this to the pixel of a 
state of impairment which is accepted as a crack of the pixel state of impairment and image pick-up picture 
signal in an image sensor 14 which is conspicuous on an image pick-up image is generated. In addition, in 
advance of actual photography, use an opaque white color plate, a lens cover, etc., and the black crack and 
white crack in bright state and a dark condition are detected, respectively. Memorize these crack location and by 
the case where subsequent defective amendment is performed, based on the positional information For example, 
even if the white crack has occurred to bright state, it does not amend according to the level, and conversely, 
though the black crack has occurred to a dark condition, it is not necessary to amend depending on the crack 
level. 

[0030] Moreover, a pixel defect may be judged using a luminance signal Y, and a defective judging may be 
carried out, respectively, using separately a luminance signal Y and a color-difference signal C, and you may 
judge further whether it is a defective pixel about an object pixel from both judgment result. According to the 
compress mode and image size at the time of carrying out compression coding of the image data, the others 10, 
for example, the camera, in the case of carrying out a manual setup, a change may be made possible or this 
threshold that sets defective judging level as adjustable may change a threshold according to the class of color 
filter put on the pixel judged that is a defective pixel. Moreover, it is good to make a threshold differ by the time 
of the dynamic-image image pick-up mode in a camera 10, and the photography recording mode which records 
a static image on a memory card 1 6. 

[0031] Moreover, it is based on the pixel value average of a circumference pixel and object pixel in a detection 
field. In case a defective judging is carried out, it is the above-mentioned data-processing section 710. And the 
comparison processing section 712 It replaces with a configuration. The upper limit and lower limit of 
predetermined width of face are set as a pixel value average, the comparison test of whether the pixel value of 
an object pixel exceeds a upper limit is carried out, the comparison test of whether it is under a lower limit is 
carried out further, and you may make it judge whether the pixel value of an object pixel is within the limits of 
these threshold value. In this case, the setting processing section 706 These upper limits and a lower limit are 
set up. 

[0032] Thus, the defective pixel detecting element 24 is not only this but the digital camera 800 shown, for 
example in drawing 12 in the case where the location of a defective pixel has become clear beforehand, 
although it is constituted based on the image data after YC conversion so that a defective pixel may be detected. 
Like the example of a configuration, it is the defective amendment section 802,804 about the position 
coordinate. You may supply, respectively, this example — the output of YC processing section 18 — each low 
pass filter (LPF) — 806,808 inputting — LPF 806,808 pixel value amendment of as opposed to a defective pixel 
to an output — each defective amendment section 802,804 It is constituted so that it may carry out. Defective 
amendment section 802,804 Defective pixel amendment control section 810 According to the defective 
information supplied, interpolation processing of the pixel value of a processing-object pixel is carried out with 
the pixel value of the contiguity pixel. Amendment control section 810 It is memory 812. The defective 
information according to the positional information memorized is generated, and it is each defective amendment 
section 802,804. It outputs. 

[0033] Moreover, the defective amendment processing by such position-coordinate storage and the defective 
pixel detection processing in the example shown in drawing 1 are combined, and it is memory 812. It is good to 
detect the abnormality pixel value of the pixel location which is not in the memorized position coordinate, and 
to make it amend. Moreover, when YC image data is memorized in the frame memory etc., you may make it the 
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defective pixel detecting element 24 output the memory address in the storage region etc. 
[0034] Returning to drawing 1 , the defective amendment processing section 26 is the pixel value amendment 
processing section which carries out interpolation processing of the pixel value judged to be a defective pixel by 
the contiguity pixel. The defective amendment processing section 26 in this example carries out interpolation 
processing of the pixel value by the contiguity pixel to a luminance signal Y and a color-difference signal C 
following the defective information supplied from the defective pixel detecting element 24, and outputs the 
pixel value interpolated while outputting the normal pixel as it was. 

[0035] The defective amendment processing section 26 in this example performs interpolation processing which 
uses two pixel values after 1 pixel 1 pixel before continuing horizontally to the present pixel, as the pixel 1000 
of drawing 10 shows, for example, replaces these averages as a pixel value of an object pixel. In this case, 
interpolation processing which replaces the pixel value of the present pixel with any one pixel value may be 
performed. 

[0036] Moreover, the defective amendment processing section 26 uses the front Rhine pixel and/or back Rhine 
pixel which continue perpendicularly, it may be constituted so that the pixel value of the present pixel may be 
interpolated, and you may make it amend the present pixel value further to the present pixel, using the 4-pixel 
value which adjoins vertically and horizontally, as the pixel 1004 of drawing 10 shows as the pixel 1002 of 
drawing 1 0 shows. Moreover, although illustration has not been carried out, the pixel value which adjoins in the 
direction of slant to the present pixel is used, and you may make it amend the present pixel value. About the 
pixel used for these amendment processing, YC pixel of the contiguity pixel used as 1 pixel can be used for the 
array of a color filter, without depending. In the example shown by drawing 10, although it was a pixel location 
to the pixel on which G filter was put also as the basis, as shown, for example in drawing 1 1 , the pixel value of 
either of the contiguity pixels which adjoin an object pixel or any or plurality, and the pixel use all the 
contiguity pixels further and corresponding to defective information can be amended also about the pixel of the 
location corresponding to other filter colors. 

[0037] About the pixel used for these amendments, it is good to ask for whenever [ with a processing-object 
pixel / correlation ] independently for every pixel of each pixel circumference, and to, amend the object pixel 
according to defective information for example, using the higher contiguity pixel of whenever [ correlation ]. 
Moreover, you may make it set up according to the class of color filter currently used for the pixel from the 
first, so that the above-mentioned threshold may be differed. 

[0038] output 1 10,1 12 of the defective pixel amendment processing section 26 a low pass filter (LPF) — 28 and 
30 it connects, respectively — having — LPF 28 and 30 It is the digital filter which the high-frequency 
component of image data is filtered [ digital filter ] and passes an inside low-pass component. LPF 28 and 30 
They are the luminance signal Y and color-difference signals Cr and Cb which were normally processed from 
the output. It is outputted. LPF 28 and 30 Each output 1 14,1 16 It connects with the compression processing 
section 32, respectively, and the compression processing section 32 is picturized following the depression of for 
example, release **, and carries out compression coding of the image data by which defective amendment was 
carried out. 

[0039] The compression processing section 32 in this example is based on the still picture compression method 
based on a JPEG method, and is a luminance signal Y and color-difference signals Cr and Cb. It is DCT about 
each the block of each, respectively. It changes and quantizes. The compression processing section 32 is 
omitted according to the compressibility which has the multiplier of the quantized data set up, and carries out 
Huffman coding to the information which remains. The compression processing section 32 is a card interface 
(I/F) about the image data which carried out in this way and was encoded. It outputs to a circuit 34 and an 
interface circuitry 34 writes the image data and the various attached information which were encoded in the 
record section in the record format which suits the memory card 1 6 which can be detached and attached freely. 
The memory card 1 6 in this example is equipped with semiconductor memory, such as EEPROM and a flash 
memory, memorizes coded data etc. to a predetermined storage region according to the command from a circuit 
34, and reads the memorized data and outputs them to a circuit 34. Moreover, it replaces with a memory card 16 
and the information record medium which records information with light and/or the MAG may be used. 
[0040] A system controller 40 is a control circuit by the microcomputer which controls each part of a camera 10 
and performs image pick-up and record control, and its circumference circuit. A system controller 40 may 
perform the various operations and comparison processing which are performed by the interpolation processing 
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in the defective amendment processing section 26 mentioned above, and the detection processing in the 
defective pixel detecting element 24 in the procedure by software, and when performing a defect in that case, 
the program which realizes the processing facility shown in drawing 7 is loaded to a controller 40. 
[0041] Moreover, to YC image data recorded on the above information storages, the defective pixel detecting 
element 24 and the defective amendment processing section 26 can judge the defective pixel at the time of the 
image pick-up of the image data, and can also amend the pixel value. This is effective at the case where record 
for example, an image pick-up signal on an information record medium by no compressing, and various picture 
signal processings are performed at the time of the playback etc. With the camera in this case, since a 
processing load is reduced without performing defective pixel amendment processing, when picturizing, for 
example by the high pixel consistency, the time amount which other picture signal processings take can be 
increased, or photography spacing can be shortened. 

[0042] As explained above, since YC picture signal processed in YC processing section 18 is inputted and the 
pixel value of the object pixel according to defective information is interpolated by the contiguity pixel, a 
defective pixel can be amended in the defective amendment processing section 26, without being based on the 
filter array of an image sensor 14. Moreover, in the defective pixel detecting element 24, YC picture signal is 
inputted similarly, the amount of pixel value changes to the circumference pixel of a processing-object pixel is 
detected based on each pixel value in the detection field to YC picture signal, and the pixel which is 
conspicuous as a crack and appears by the image pick-up image can be detected. 

[0043] Moreover, in case YC conversion of the output of a color image sensor is carried out, YC picture signal 
is generated using a 3 pixels long pixel value, and when the detection field which covers it is prepared, good 
amendment processing is performed, without being influenced in the case of defective amendment of the 
defective pixel derived in the pixel used in the case of YC conversion. 

[0044] Thus, the pixel determined as a crack can be amended in the above-mentioned example, without 
performing interpolation processing by the pixel with a big distance between pixels, without being based on a 
filter array, since detection and amendment processing of a defective pixel are performed to YC picture signal. 
In this case, it is not necessary to perform interpolation processing which is needed since there are no 
components other than the opening pixel in an image sensor, i.e., the color component filter in a predetermined 
pixel location, in that pixel location. For this reason, it is not necessary to hold the pixel according to the array 
of a color filter, and increase of a circuit scale can be avoided in the case of defective detection and amendment, 
moreover, to a defective pixel which is not conspicuous as a crack, it may not need to be alike to that extent, it 
may be necessary to respond and amend about an image pick-up image, and a processing load is mitigated also 
in this case. 

[0045] Moreover, although it is appropriate to process to brightness and a color-difference signal, in view of the 
compression effectiveness in case picture compression coding is carried out, it is possible for it to be 
incompressible, and to detect the pixel defect at the time of their being picturized also to YC image data 
recorded on the information record medium also as opposed to YC picture signal which processed such and was 
recorded on the information record medium, or to amend. 
[0046] 

[Effect of the Invention] Thus, according to this invention, since the defective pixel is amended to the picture 
signal of the format of a luminance signal and a color-difference signal, the defective pixel which can avoid 
increase of a circuit scale or a processing load, and is conspicuous as a crack is detectable good. 
[0047] Moreover, since such processing can be performed ** [ according to / the color filter array of an image 
sensor ], detection / amendment processing of a defective pixel can be performed simply and correctly, and 
improvement in a result and image quality can be brought about. Thus, without a circuit scale increasing 
according to the color filter put on an image sensor, a defective pixel can be amended, and it is stabilized and a 
defective pixel can be detected. 
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^PfeffijESSg. 

[ fl*#«l 9 ] f^*^3 JCEttO«iE36«{C*5V^. 

«WEli«m#«r ferity c t ZftWct -rz> ® 
3f*Pfe*tIE£lgo 

[ f»3fc«2 0 ] M3R«1 9 tC|SttoMjE^g|C*5V^ 

So 

SlMiE^gp 

A;b"*-<5 *J3¥»£ . 

go 

[ W#«2 5 ] fflf*^2 4 (CCttOttUSmiC^ 

izwm^wmt^xmm^xa&nmr* wm^wt 

l W#«2 6 ] »*S2 5 JC|E«^tt|«BJC*5V> 

tx mzxm^&ni. mBMMEm*>wmm&+ mem 



MEftsmifctt* MjB®*«5p^ «rE»*ir*o> 
5 r ^ i-s pr^^Pfe^ttj^gc 

[ »*«2 8 ] «f**2 6*fctt2 7 ICfE^O^ffi^ 

5 K*#**r4tfC £ £*m<h i"5 ®*^RI^di^go 
[ »*«2 9 ] f»*B2 5 *C|5*^*aKgfC*5V* 

[ 13*313 0 ] 1**92- 9 tce*fc«>4ft£H2Mlc*sv* 
"C> *BBWffc«kH\ »«E«»miffrMK 

5X5 wm>mmnpW3t:itu-r& n t -re ® 

[ f»*:«3 1 ] tt#m.2 4 lcSE«o«a*«lc*5V^ 
[ »*q[3 2 ] njv%3 l lcStto«ai^g^fev> 

m\zmw&mz8mtz mm^m^x^mmm^<D^m 
s<r^»ii»offig^cfe*tt***a^r« ^Pi« 

[ fi5R^3 4 ] W#S3 3 tCffi*(0«iE*«fe«C*5VN 
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«**/Bv*ri»»flr*«>fi« 

«at5«Bia«r*^ *»BX«W*«»*fc:fS 
[ Wf#«3 8 ] »*«3 7 ^ClE^^MJE^^feiC*3V^ 

«ria*mxaw\ 

k. 

jgi &£xtm2 o*»xaic-eBi»u*:**v«iT^>iHr* 

[ W*^4 0 ] f»3JW3 9 fc|E*OttjE;^fc:*5^ 

[ f»*«4 1 ] 9I*9L4 0 ^|B*0*jE*felC*3V^ 
Tx BWBifclSxaW:, ttEPRRVW^: NCWkiafO 
W^^»*S5M6^*«ta-r«*»XS«:*^ ££M 

[ W#«4 2 ] W*«4 o *fctt4 l fcffi*fetf>*fjE# 
« RftX»«:*trr. * ih5 If^HMlKE^ft. 

[ is*«4 3 ] ga#gi3 9 fcB*^«EWfctc*s^ 

^ftftnXn mf( m. n fi3 £JLk0>-SHft) <DMiff£>? 



[ ff*^4 4 ] M**4 3 |CE«0*tiE*^fe^*5V^ 

5X5 S^lfMt7««rSKtt|-ra - £ Sr^gte If 

[ IS*^4 5 ] f»**3 7 iCfS^M^fefC:^ 
T\ K^BMKEXS^TMjE* JxfciMfcflT 

[ fi#^4 6 ] MstoHs 3 fcB«o*iE*»tc*3V^ 
WEtfcBWaitfi^xatt. IIH£«flkS?0*lfe«lt 

«re*w&*jExaM\ griEffiawwiicjEsufciii*^!!* 
[ n«3S4 7 ] »*S4 6 tclamoMx^^^fe^c^5v^ 

[ »#*4 8 ] S»*«3 3 tCl|5*^MiE^fetc:*5V^ 

[ l»*«4 9 ] f»*«3 3 ^IS^^MlE^fcjoVN 
«TIB*WS4*jExaw:. ^R6*iE>Wfelii*oa&7^v 

l W*«5 0 ] HMW53 3 {c|E^c7>MIE^^^vn 

t> wis^riwexsw:, ffijEttMtmmnmm&m&wi 

IBiWft*-7-lC*5tt«»«-feyHC**$ yu^r ^ 

fcJfcC T > «X^fe$r C k Z ftWtk -rz> 

[ »*«5 1 ] SS^3 5 {c|5^^MX^■ifet-*5V^ 

s^k. «HE**xa«:, iwawfcif^fe a** n 
&k ihs mmxt&ffiiEirm* 

wc, r b ffT*&««cE^iju ti^^—y^ >v# ~eh z> r. 
[ ffl»*qC5 3 ] tt*q[3 5 lc|5©coMX^tc^oVN 

[ »*3S5 4 ] fB*3S3 3 ^|5^c7)MiE^(C^V> 
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ffri5^*®^ji^^M^M:$r^#i-5Si <z>ifc#xa 

[ »**5 6 ] «f3JW5 5 JCfE*0|ftaj*8MC^ 

t\ anEM«xatt, mettMmmv>mmm&. msm 

[ W#«5 8 ] »#qC5 7 |C|5t6^tH^(C*3V> 

Tx swBtt:«xatt, «nEM*«wt wie»*®*o> 

[ »**5 9 ] W#55 7 £fc|*5 8 iCfSmcO^ai^ 

CO^HmXn Rft( m N n 1*3 £A-fc*>#«) OlRROp 
[ »*«6 l ] tt#K6 0 fClE«<OttiH#ifcfc*3^ 

5X5 nitoincOTtttriitti-r* r t &&mt ra vr 

[ fg^rie 2 ] f»#«5 5 icea*>*ffl*ttfc*«o 

fc«iftbr«rtE®««-§-S:ffl*-*-«lf*Xa«r«^. tt 
f5Artxa«\ tt*»xa^TSE«$tufc®««*«rA 



[ W*^6 3 ] »*3R6 2 «£lE«©*m*Bflc*Ho 
[ 0 0 0 1 ] 

$ ^fc«»*^*6> aws na A*>U % s& 

[ 0 0 0 2 ] 

*7d**&u-c#Tv^ 0 r.t^j:5 ^^7fcr±, cc 
[ o 0 0 3 ] tit ;tff. tV ^^f^9W, 

[ 00 04 ] t a*LT„ *«"ffe-fe/i>-c(ir a* toUS^ 

[ 0005] ^rrr% 

#a^>^RSiii*iO*jE*^5|5B**5J: 

[ 0006] #^^6-30425 « 

*»«3E$ JxtC C D ttJA^#*^lf*(!!lS:*t 

xvr*mt>zm> mim^mm^m^ tix^it. 

[ 0 0 0 7 ] 1»BBiP9-2055a6#^*BWCf±, ^CPil® 

fco C co^a-Cfi. m^SIMKi: coFrO 
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[0008] 

^ft y^h ^TKTMiE&JlSrfT? *frT?H\ ft 

[ 0009] iHRo^^HWkW^-Cfl. 4»fcfi 

[0010] *5BW4r <7>J:5 ftf£*^<o*j&«:«¥83 
[0011] 

tits tiz wmmttAjji, , Wc&m*K&iirz>&mm& 

* *vfc®£tff Art"*-* T^l^Wtt s *flfl®3?f<7>#:g 
KJSC *ttflMR«*«U: . A7J 

[0012]**:, *mm±±&<nwm*tim'*z>'fc)h 
mm** atjl s iwfcaww** a mm 

i-5*tti#®i:«:*Sr^ *J*liSJ3i2tf>® 
*l *>J&##J££. *f#!®Sf?>®Ii?fii£r 

^2 , mi fei ^2 

[0013]^!:, **^tt±56o»SS:»ft-r«fc 



A*i"* A^X^i: . *»]E*0{fci»£JESU> fc 

a^j^ *t5 B«ft«#ic*5»ta *fti®^£r*f lE-rs arms 

aEiatSr-a-*. *H&*tjEXSf±. *Pfetil»fc:j£fc itm 
[0014] Sfc, *»Wtt±3*0«««r«Blli:-t"Sfc«> 

A^-rSArtlS*. ®««^<Z>»bfiS:*tfi 
"TatftffiXS^S:*^ «fflXSf4. xt^li^ia^® 

Ki#i-a ^2 (nW&J-gLt . mi *5<t T>*m2 <D&»JM 

kcxm^vttn^tKDmmmzm^^x^ M&mm& 

[0015] 

I«P^lclS0^tS o Hi 

12$r^U T»«$ ixa **»«rJWk3lHF14*cr 

K ie*Of»«Blt3^fclE«*'*«7V WW* 
710^ Jxtv^o ror^*^^^7iott, YC 

V^T**W^tt«iB«OftV^»5>tt. 0^J:t«:OUi 
[0016] ^^14f±. M*iJ:t5***Wlc** 

-f ^ b 1^ * =7 — ®«^r^i"5 

^fta ^.^^ i: tix&y . *&mmxi^ 
*x-c> -tJvenft-^a^^R • g - b ( #• »• 

#) rTi: ^Mft5«Mfe^^J*^turv^o 
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[0017] SttJRffelR^H;:!*. — ^(Om^±(7) 

fctuSo «p£oRii*is>:PiSiif*-efcSi:-r 

4ej£L fcjBW«-9-Y Ss J: ^IfatC coy C Hj^fa 
m.T*»WiE£?Tt/\ :©J:}ftYCIIt»* 

[ooi8] JWft*T-i4otfj^3ioo tctt N ^?wm 

20K: A;ft£ H5oC: -e«fip$ tWbRGB j£JE2fc(BW*« 
#102 T^-d>/- S^/l^ft(ADC) OS§22frC 

[0019] T^uf- 9V v^>0^&(ADC) im^oaj 
^J104 J2Y C #!S3i518tC^J6£c* ^ x YC «Htt18tt« AD 
C EeIS§22J: «9 ta^j* ix« RGB Miff <f #104 fr*IBttt*Y 

*3<t tfft*»»c coy c mm -#fc&«-#-3 

[ 00 2 0 ] *HJfi«^*3ft«YCtea»18W:. JOS** 

7k^*lfillcB»i-«3 !IXfcAl*.*:6 Bff*«r^V^. Hi 

[ 00 2 1 ] HL< t±YC*QS»18W\ H6 tC^f* 9 
ic, /Wb£ frufcRGB M^ff#l04 £r-e#IEf£ir 

5^77> *!J 600 £ % s^y^Tt^V 600 HSS^ 

tU5 RGB ®lff{f #602 £: T^fMcO tH^l604a,6 

04b,604c,604d t^ffl*-T5 »RlilB(SEL) 606 t £*TU 
TV^o *Offl*604a{C^$ix5YH^W&affl608 
i: >- ffi*i6G4bK:^£ *v5 £ W\ 

6o YH^fc«iSa5608 Oi«;«*5>YHffl^f4, *D*32612 
<0—J?<DXtlk * — 7>f J\s* (LPF) 614 £ «C«*S£ 



i: ©^^c5>YL<t £<&j£L T{f #(YL-YH) £:3=/&b > * - 
'<*7^< JV? (LPF) 616 iC^-T5o ^JDg:^618 fi-^H 
■^tuOLPF 614,616 «CT*&a$ Hfc/£#{t#£(YL-YH)+ 
YHi: V>5 ^fI#0^$rfroT, *r*«#Y*ffl>j10 
6 tctb^-r^c 

[ 0 0 2 2 ] il^im^606 coaj^604c,604d tC-^^tb 
tb^ Cr^^^620 5$£ t^Cb^J*«k^SP622 

o — ^ (LPF) 624,626 fi-^iT.-e^ 

-7 << >\s* ftm~, X&mm-^C (Cr.Cb) & tB^J 1 08 

[ 0 0 2 3 ] (-YC^lEl?Sl8tt, RGBpf^x 

— ^ ffimtemx, x&mrn&mz&vz rgb #pj^m 

t> ^3 M^^J^S*5J: tffe**»©»flr*«:^ 
^-T5o YC^S[U^18COtti^106 *5£U*108 fi. 

ir**w»24^ ^Pfe«^sia526^ ^tL^frmmz h 

[ 0 0 2 4 ] ^RSilj^tii$i524fi. A^3106,108 

[ 00 2 5 ] ***«lC*3Jt«^C»®*<ftW»24f±. ^ 

i?&-rz>mmmmmk , ^o^s*f*®*i«*Ri 

-T^o PU< fiH7 tc^J:9 ^P(Spj^ai^24 

moo t . &mtt&mm<Dmmm&wim-rz &&mmwi 

*W»f **I**3B»704 t . ^J^««tP704 {CT^J^ 
tPc ^J^^704 * <b {c^iaW*o®*«4:5p^ 

^k-rs ^*wk*Q!S»708 s w-mitz titzmmmmmit 
tt&m&<ommmk nimMknuir* mm #mmi 

ix, &m&&mm&%;fa<?>mmmx-hz t ws-tz 
Gfr&w-rttmisM&totii-z Jt«*asa$7i2 1 

[ 00 2 6 ] »ia®*Br»#!.3»700 tt. AS^HfePK 
^5700 MS ^-TJ:5 lc^*pjS800$r*^*r5 

^«5 xs mmmmoz o&mmis&^t^timi&r 



(8) 



»W2 001 -1 6599 



-rx? c *fr*®*9oo«ia0>3 x3 mmffl$&Q2si± 

[ 0 0 2 7 ] H7 Clot, ^i221iJ*ll^3S»700 

708 tC^i~^o JSiaM*0f*WDfa«7OO W\ & 

9^M»«r^ir»R4MS«7Q2lcft»U. *MMT 
*»»«iaa$702 f±s *01i*«<Offl^*^$ V^SrS 
5fcft^-^Fi5tSUT. *JS«ia«704(O»««! ! a«71 
0 » ¥*WfcftkS»708 H\ A^$*b*»iB® 

[ 0 0 2 8 ] «*ftygffl710 W\ ^^^708 tCT 

nm*z>$m&-z%>*o \^it&ix*?m&ix^ 

tfWv^C***:*. fSWAaSifcv tt$mm<D 

mmm*. mmmmt <ommtm< > tt&mm&xv&m 

[ 0 0 2 9 ] tb^fiBUttJtlttftnff712 fciSfe 

*u Jt«««*fB7i2 tts -toffiB8*ts K^*aaas706 

H:««!.S»712 (7>tt:«ttl^714 tt. 
*HrtP24<&atfj*r*j*b, ^WjEMAtt26lCttR$4x 

*L*>*xffi«&sB«L, ^(D&mmm-m^x, *<n 

Ltfi^rX«tTV CO V ^/M^/fcC T«IE^ 

[ 0 0 3 0 ] ft*«*Y^*Srttflauriil*^te 
«r*U*L Xt> «fc < , £ *u JMt«#Y <h feifltC * £ 



#»Kfe-*-5*&«>ia*^ fcirx:^ * * 7 lOKTPHft 

[ 0 0 3 1 ] ^7t. «ttJ««{Cfelt««iapl*OIil*ffl[ 
Sfr*®^ K^V^Ts ^Pfe*J*i"5 J^|5 
co^m^^710 t5Jt^^712 co^tcftx. 

[ 0 0 3 2 ] n tO«t5 C ^RSPf*«ffl«P24tt, YCf 

7F~$-*r4 i?& fls* * 7 800 co^|jS:^Jcoj:p tc, ^rco<4@: 
J^*S:^:»l«iE»802 i 804 {c^^n^U XJ; v> 0 n 

PF) 806,808 (CA^JU> LPF 806,808 <D tfi^fCStUT. 
^Pflpj^tCl^-i-^ HB5«4*jESr«-^»«iE»802 i 804 \C 
Xm> «C»**^TV^a. ^P(SMIE^802,804 Wt. 

>:KlBr«4«jE«iJ«i«1S8l0 J: «p *t5 ^PfefS^l^o 

ra^s-r-So .ttjE«!Wtt8io -c*i. ^ 812 tcistt^ 

IE^S802,804 ^dti^-rSo 

[ 0 0 3 3 ] Hit* ceo J: 9 *ffifijffi«aB»tc J: Svelte 

«jE^mi:. mi ic*^^«»c»t**»iir3i»a«i 

St ^ria^^^rT. ^ ^ey 812 I^IEME* tefiili 

{z-t-%t£\,\ *Mlii**tfi«fl524f4, ^^-^.^ 

^E-y 3&if{c-CYClii«7*— ^«rE«UTV^*&fctt. 

[ 0 0 3 4 1 H1 l^lot, ^te«jE^^26fi> ^Pi . 

3g3P26tt\ ^pdpi*i*a^24i 5 xmmmz 

[ 0 0 3 5 ] ***^J^*5»t6*C»«3Eft!fS»26tt, m 

iu^c^fux^ iaiocoil^iooox^-r<t9 i:^ TK^rSi 
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fit, itt jL&z*ib<o¥miS£*ttfmm<ommfeb 

ooii*«T?3R[if*Oiii*«[«: g£ JiWfcaiSrfT 
oT*> J:v\ 

[ 0 0 3 6 ] ^RS«EAka»26f4, il^i^Mt 

< , Sfefcif** 01OOIiJ^1OO4-e^-r<t5 _kTfc& 

1 pf*^*5 ©BWBir*OTC Ci:3ft« 

[ 00 3 7 ] C^bMiEOfcft^ffi^^ilj^{CoV> 

*><fcv\ 

[oo38] M&mm&^%±mu2G<Dmt}wo t w2 

n — 7 -f yu* (LPF) 28,30 tC^ix^tl«Jl** *K LP 
F 28,30 W\ I«r-^ ©iU^SrttaUT^Offt 
i£3 f>f 5** ^7 -r /u* -e*> a o LPF 2 

8,30 0>mM*h «\ ]E#«cftia$ ^*jwtflr»Y t . 

fiSn^Cr.Cb^^UAdixS. LPF 28,30 <o&mti 11 
4,116 tt. ^^ix£BBteS»32^Sa*$^r*5l3 . EE 

[ 0 0 3 9 ] *H16«»»C33^5£E«Aafa«32tt. JPEG;* 

ifrihliiffiffi^icsmi, % *«t«*Y:teJ: • 
t^^m-^Cr.Cb *ive*u7>#:/ni y {7 *r**u«UDCT 
KlftU, *Hbi"<5. EE«*Q««32tt:, S^bUfcT 5 — 

»«fc#U"C^7^V«F*fls-t-«. EE»teS»32tt, d 
KbTW^fbLfc®*^-**, *-K^7 
*(!/F)lHlHr34{catfjL. ^y^7x- *|§II&34 



mmm^z *mwnc&tfz* ^y * — k ie 

W\ EEPROM, 7^ y is*.**}) Zf<D*m#& *V &ffi 
fflUTI5I^34tCtfci^i-S 0 ^ ^ey H 16^^ 

[ 0 0 4 0 ] ^rAnyf a— 7 40«\ 7 10<£># 

^»LT, j«fclB J: t««tW«rr» ▼-f ^ p a v 
7fA^>h 740tt. ±*Lfc*l6*IE*asJS»26fc: 

^Vh v—=7 40ICO — K $ □ 

[ 0041] *:Ri®**£iJW24*5J:r5>:teiijEfti 

»PI««r*l*UT, *©lii*«[«r*jE-*-«r:i:t>-e% 
5 0 -Hit fct^ff, J6ffeft^Sr«l£E!ffi(criS^IB® 

xzz> 0 

[ 0 0 4 2 ] ^±nmVtzX^> tC s *tt»jEft! ! a«l526T» 

fi. YC^a»l8^-c*&S$ixfcYCPifkf»#iSA^$ 

*u5*»fe, ««*-?-i407-r^iB^J*cj:b-r 

^ttJ^24T*li. P3«*CYC®««#3flSA^Jx-C. YC 
®^f§^-td^i-S #Hf*«^»<5v^ 

[ 0 0 4 3 ] £fc. aHft*^offl^j«rYC3E*i" 
fci:^rtf^3 ®*(7>il*tt«:^V>TYC®«« 

m&az. y c Kiicteflii* h^ ®^tcr 

&zttvx%ifommv>&m&£ vmiE$m&ff<>x^z 
<dx. y^/^mmc^^T\^ mmmvm<o*: 

A^7^ ^K^OA5>^onRtt:Rlcftv^»^ 
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&sas*< . isi*a«o*^ia»-r« r. t 

[ 0 0 4 5 ] M«BE«##fl7j-* Kfcf±, 

[ 0 0 4 6 J 

[ 0047] <c«yatt> MHift*^^ 

[ 01 ] *»K^igfflS titzv** <omi$& 
Tjk-fzfv y 9 mxhZ o 



*t3 &^^Cr£r^r0-e;fc5 . 

I las ] xmffijEmmu&xxfXfamm&mmi^xz 

[ 1216 ] YC toatiSOfll^ftlSr^^n * ^ HT?*5 B 

So 

I 09 ] &mn&mmicfcKtzfemm&<r>mnmz^ 
mx&>z>« 

i mi o ] Mminut6RoiwmM)m 
^-r0-?&5 o 

i mi i ] Ao^i«m«r*n^^iRoRijHm»«> 
m&m& 5*1-7 * y * mxhz . 

10 T'f '^^^7 
18 YC*Q«£[5 

26 ^PfefiTOQsSSlS 

28,30 nw^7^ (LPF) 

700 mmmm&&t&mn 

702 «*nRft«A3Sff 

704 ttft&att 
706 &®cq«£B 

708 iFfiMb*BS« 

710 iKI^SA 

712 ttftftiSffi 



[ 01 ] 



[ 02 ] 




GRG 
GB6 
GRG 
GBG 
GRG 
GBG 
GRG 
GBG 



BGR 
RGB 
BGR 
RGB 
BGR 
RGB 
BGR 
RGB 



GBG 
GRG 
GBG 
GRG 
GBG 
GRG 
GBG 
GRG 



[ 03 ] 



Y Y Y 
YIY 

y tt 

Y YT 

Y Y Y 

Y Y Y 

Y Y Y 

Y Y Y 



Y Y Y Y Y 

Y YY Y Y 

Y YY Y Y 

Y YY Y Y 

Y YY Y Y 

Y Y Y Y Y 
YY Y Y Y 

Y Y Y Y Y 
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[ 04 ] 



[ 05 ] 



[ 08 ] 



Or Cr Cr 
Cr Or Cr 
C r Gr Cr 
CrCrCr 
C r CrCr 
CrCrCr 
CrCrCr 
CrCrCr 



C r Cr 
CrCr 
CrCr 
CrCr 
CrCr 
CrCr 
CrCr 
CrCr 



C r CrCb 
C r CrCb 
CrCr Cb 
C r CrCb 
Cr CrCb 
Cr CrCb 
Cr CrCb 
C T CrCb 



CbCbCb 
Cb Cb Cb 
CbCbCb 
CbCbCb 
Cb Cb Cb 
CbCbCb 
Cb Cb Cb 
Cb Cb Cb 



Cb Cb Cb 
Cb Cb Cb 
CbCbCb 

Cb CbCb 

Cb Cb Cb 
Cb Cb Cb 
Cb Cb Cb 
CbCbCb 



802 





























J- 























































































































800 



o 









r 


SEL 


I r 

G02 





606 18 1 

YHgfjggSB j j LPF "j 1 

«f * I j (VL- YH) ^ 6 + 1 106 

T" ^ 6Q 4c 612 ^62 4 618 

?02 -^ H cr^ana s 1 - H lpf j r » C g 

60 4d j ^62 2 ^1 6 



i k i t i i i i i 
i i i i i i i 



624 618 



626 

^5 



108 



700 


i— ^* 


1}* 










90 


2 






-1 H3IBSMM&£ : 1 




j as^sas | 




















702 






































/ 
















































24 


fV714 
701 T 





















































I I I I I 
I I I I I 
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[010] 



1000 

























i 



























































































































-1002 



I I I 
I I I 



1004 



i i i 
i i r 



o 



[ mi 2 ] 




%, L 



18 106 MS 



LPF 



108 808 



802 



32 



LPF' 



810 



800 



BEffi 



34 



l/F 



| grog | 



